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Abstract. We obtain functional central limit theorems for both discrete time 
expressions of the form l/^NJ^l^Jl {Fi^inin)), ■ ■ ■ ,X{qt{n))) - F) and 
similar expressions in the continuous time where the sum is replaced by an in- 
tegral. Here X{n), n > is a sufficiently fast mixing vector process with some 
moment conditions and stationarity properties, is a continuous function with 
polynomial growth and certain regularity properties, F = J Fd{fj, X ■ ■ ■ X fi), 
fi is the distribution of X{0) and qi{n) = in for i < k < £ while for i > k they 
are positive functions taking on integer values on integers with some growth 
conditions which are satisfied, for instance, when g^'s are polynomials of in- 
creasing degrees. These results decisively generalize |14) whose method was 
only applicable to the case k = 2 under substantially more restrictive mo- 
ment and mixing conditions and which could not be extended to convergence 
of processes and to the corresponding continuous time case. As in 1141 our 
results hold true when Xi{n) = T"fi where T is a mixing subshift of finite 
type, a hyperbolic diffeomorphism or an expanding transformation taken with 
a Gibbs invariant measure, as well, as in the case when Xi(n) = fi{Tn) where 
Tn is a Markov chain satisfying the Doeblin condition considered as a sta- 
tionary process with respect to its invariant measure. Moreover, our relaxed 
mixing conditions yield applications to other types of dynamical systems and 
Markov processes, for instance, where a spectral gap can be established. The 
continuous time version holds true when, for instance, Xi{t) = fi{^t) where 
i;t is a nondegenerate continuous time Markov chain with a finite state space 
or a nondegenerate diffusion on a compact manifold. A partial motivation for 
such limit theorems is due to a series of papers dealing with nonconventional 
ergodic averages. 



1. Introduction 

Nonconventional ergodic theorems known also after [T] as polynomial er- 
godic theorems studied the limits of expressions having the form (cf. [8]) 

l/-^X]n=i -^^^^"■'/i ' ' ' -^''^'"■'/^ where T is a weakly mixing measure preserving 
transformation, /,;'s are bounded measurable functions and g^'s are polynomials 
taking on integer values on the integers. Originally, these results were motivated 
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by applications to multiple recurrence for dynamical systems, the functions fi being 
indicators of some measurable sets. 

After an ergodic theorem (or in the probabilistic language: the law of large 
numbers) is established it is natural to inquire whether a corresponding central 
limit theorem holds true, as well, though as usual under stronger conditions. In 
this paper we prove the functional central limit theorem (invariance principle) for 
expressions of the form 

(1.1) (F(X(g:(n)),...,X(Q,(n))) -F) 

^ n—l 

and for the corresponding continuous time expressions of the form 

(1.2) -j= {F{Xiq,it)),...,Xiq,it)))-F)dt 
V N Jo 

where {X{n),n > 0}, (or {X{t)},t > 0) is a sufficiently fast mixing vector valued 
process with some stationarity properties satisfying certain moment conditions, F 
is a continuous function with polynomial growth with certain regularity properties. 
F = J F d{fi X ••• X /i), where fi is the common distribution of X{n), {qj{t)} 
are positive functions, (taking on integer values on integers in the discrete time 
case), qj{t) = jt for j < k and for j > k they satisfy certain growth conditions. 
For instance, it would be enough if {qj(t)} are polynomials of increasing degrees, 
though we actually do not need any polynomial structure of functions qj, j > k 
which was crucial in papers dealing with nonconventional ergodic theorems cited 
above. 

Our methods rely on a martingale approach which have played a decisive role in 
most proofs of the central limit theorem during the last 50 years. In view of strong 
dependence on the future of summands in (jl.ip application of martingales in our 
setup does not seem plausible on the first sight. It turns out, somewhat surpris- 
ingly, that an appropriately modified martingale approach still works well in our 
situation if we construct the filtration of tr-algebras so that in some sense "future be- 
comes present" . Unlike the classical situation our functional central limit theorem 
yields a process which has Gaussian distributions but not necessarily independent 
increments and we demonstrate an explicit example of such limiting process with 
dependent increments. This interesting effect rarely appears in natural models. We 
obtain also a functional central limit theorem in the corresponding continuous time 
case which only recently was treated in the sense of nonconventional ergodic the- 
orems (see [5]). It turns out that the limiting process in the continuous time case 
has a somewhat different structure than in the discrete time setup. These results 
generalize [M] where the partition into blocks and the direct use of characteristic 
functions showed applicability only to the case k = 2 under more restrictive condi- 
tions and neither the functional central limit theorem nor the continuous time case 
could be dealt with by the method employed there. 

As in [2] our results hold true when, for instance, X{n) = T^f where / ~ 
(/i, /p), T is a mixing subshift of finite type, a hyperbolic diffeomorphism or an 
expanding transformation taken with a Gibbs invariant measure and some other 
dynamical systems, as well, as in the case when X{n) = /(T„), / = (/i,...,/p) 
where T„ is a Markov chain satisfying the Doeblin condition (see [12]) considered as 
a stationary process with respect to its invariant measure. In the dynamical systems 
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case each /; should be either Holder continuous or piecewise constant on elements 
of Markov partitions (see [3]). As an application we can consider F(xi, ...,xe) = 
x[^^---xf\, Xj = {xf\...,xf), X{n) = Xj{n) = Ia,{T^x) in 

the dynamical systems case and Xj{n) = I^.(T„) in the Markov chains case where 
1a is the indicator of a set A. If N{n) is the number of Vs between and n for which 
T^^x £ Aj for j = 0, 1, k with k = i (or Tj-; € Aj in the Markov chains case) 
then N{n) is the number of fc-tuples of return times to Aj's (either by T'x or by 
T/) which form an arithmetic progression of length k having a difference between 
and n. Our result implies in this case that n~^/^(iV([tn]) — nt{^{A))'') , t £ [0, 1] 
(where /x is a corresponding invariant measure of T or respectively) weakly 
converges as n — >■ oo to a Gaussian process having not necessarily independent 
increments. Substantially more general than |14) setup of the present paper enables 
us to apply results to additional classes of dynamical systems and Markov processes, 
in particular, to those having a spectral gap. 

The continuous time version holds true, in particular, when Xi(t) = fi{Tt) where 
Tt is an irreducible continuous time Markov chain or a nondegenerate diffusion on 
a compact manifold, as well as Ornstein-Uhlenbeck type processes. 

2. Preliminaries and main results 

Our discrete time setup consists of a p-dimcnsional stochastic process 
{X{n), n = 0, 1, ...} on a probability space (il, F, P) and of a family of a-algebras 
Tki C J^, — oo < k < I < oo such that J^ki C J-'k'i' ii k' < k and /' > /. It is often 
convenient to measure the dependence between two sub cr-algebras 0,1-1 C T via 
the quantities 

(2.1) Wq^pig,!^) = sup{|l£;[.g|^;] - E[g]\\p : g is H - measurable and < 1}, 

where the supremum is taken over real functions and || • ||r is the L^{^1, T , P)-norm. 
Then more familiar a, p, </> and ?/;-mixing (dependence) coefficients can be expressed 
via the formulas (see [4], Ch. 4 ), 

(f>{g,'H) = |tooo,oo(^,'H) and ip{g,H) = ■nji,ao{Q ,'H). 

We set also 

(2.2) Wq^p{n) = SUpVJq^p{T-oo.k,J^k+n.oo) 

k>0 

and accordingly 

a{n) = ^n7oo4(n), p{n) = m2,2{n), 4>{n) = ]^TUryo,ao{n), i}}{n) = roi^oo(")- 
We will impose mixing rates, i.e. rates of decay of Wq^pin) requiring that 

(2.3) C{q,p) ^^ujq^p{n) 

n>l 

is finite for some choices of p and q. Our setup includes also conditions on the 
approximation rate 

(2.4) P{p,r)^sn^\\X{k)-E[X{k)\Fk-r,k+r]\\p- 

k>0 

In what follows we can always extend the definitions of Tki given only for k,l > 
to negative k by defining J^ki = J^oi for A; < and / > 0. Furthermore, we do not 
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require stationarity of the process X(n), n > assuming only that the distribution 
of X{n) does not depend on n and the joint distribution of {X{n), X{n')} depends 
only on n — n' which wc write for further references by 

(2.5) X{n) ^ /i and {X{n),X{n')) ^in-n' for all n,n' 

where Y ^ means that Y has /.i for its distribution. 

Next, let F = x^), Xj G M.^ be a function on R*^^ such that for some 

L,K > 0,K € (0, 1] and all Xi,yi G R^, i = I, i, we have 

e e e 

(2.6) \F{x,, xe) - F{y,, y,)| <K[l + Y, k.T + E M E I^J" " y^'l'' 

and 

(2.7) |F(xi,...,x,)|<X[l + E|2;.T]- 

To simplify formulas we assume a centering condition 

(2.8) F = J F{xi,...,xi)dfi{xi)---dfi{xe)^0 

which is not really a restriction since we can always replace F hy F ~ F. Our goal 
is to prove a functional central limit theorem for 

(2.9) eA^(t) = -=E^(^('ZiW) — .^feH)) andte[0,T] 



n — 1 

where qi{n) < q2{n) < ■ ■ ■ < qi{n) are increasing functions taking on integer values 
on integers and such that for j < k, qj{n) = jn, whereas the remaining ones grow 
faster in n. We assume that for fc + 1 < i < ^, 

(2.10) lim {q,{n + 1) - q,{n)) ^ cx^ 
and for i > k and any e > 0, 

(2.11) liminf(g,+i(en) - qi{n)) > 

n— f oo 

which implies because of p.lOp that 

(2.12) lim (gj+i(ert) - gi(n)) = oo. 

To shorten some of arguments wc assumed that qi{n) is increasing in both n and 
i but, in fact, (|2.10p and (|2.1ip imply already that this holds true for all n large 
enough which suffices for our purposes. For each 9 > set 

(2.13) j^^^\\X\f,^E\X{n)f^ J N%. 
Our main result relies on 

2.1. Assumption. With d = {£ — l)p there exist oo > p,q > 1 and 6,m > Q with 
(5 < K — I satisfying 

oo 

(2.14) ^zuq^pin) ^ e{p,q) <oo, 

n=0 
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(2.15) 5^[/3(g,r)]^ <oo, 

,r...^ . 1 1 i + 2 (5 

(2.16) 7m < oo, 72„,, < oo with - > - H h -. 

2 p m q 

In order to give a detailed statement of our main result as well as for its proof 
it will be essential to represent the function F = F{xi, X2, . . . , x^) in the form 

(2.17) F = Fi{xi) + ■■■+ Fe{xi,X2, . . . ,x,) 
where for i < £, 

(2.18) Fi{xi,...,Xi) = J F{xi,X2,-.-,xe) d^i{xi+i)---d^i{xi) 

- J F{xi,X2, ...,Xi) d^i{xi) ■ ■ ■ dii{xi) 

and 

F(>{xi,X2,...,xt) = F{xi,X2,...,Xi) - J F{xi,X2,...,xe)d^j.{xi) 
which ensures, in particular, that 

(2.19) J Fi{xi,X2, ■ . ■ ,Xi-l,Xi) dlJ.{xi) = V Xl,X2: ■ ■ ■ ^Xi-l. 

These enable us to write 

k I 

(2.20) ^^(t) = ^^,-^(jt)+ ^,-^(t) 

i=l i=fc+l 

where for 1 < i < fc, 

(2.21) e.,Jv(i) = E UMn).X(2n), . . .,X{in)) 



and for i> fc + 1, 

[Nt] 



(2.22) i,^r,{t) = ^^F,;(X(gi(n)),...,X(g,(n))). 



2.2. Theorem. Suppose that Assumvtion \2. 1\ holds true. Then the t-dimensional 
process {^i^N{t) : 1 < * < ^} converges in distribution as N oo to a Gaussian 
process {'r]i{t) : 1 < i < £} with stationary independent increments. The means are 
and the covariances are given by E[r]i{s)r]j{t)] = min{s,t)Di_j . For i,j < k, Dij 
is given by Proposition \41\ Moreover Di,j ^ if i ^ j, and either i or j is at 
least k + 1, making the processes {?7i(-)j i > k + 1} independent of each other and 
'^f ■ j ^ ^or i > k + 1, the variance of r]i{t) is given by tDi^i where 

D,^i J \Fi{xi,X2, ...,Xi)\'^dfi{xi)dfi{x2) ■ ■ ■ dfi{xi). 

Finally, the distribution of the process ^Ar(-) converges to the Gaussian process ^(•) 
which can be represented in the form 

k i 

(2.23) e(i)=E E 

1=1 i=fc+l 

If k > 2, then the process £,{t) may not have independent increments. 
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In order to understand our assumptions observe that ■cuq^p is clearly non- 
increasing in q and non-decreasing in p. Hence, for any pair p,q> 1, 

Furthermore, by the real version of the Riesz-Thorin interpolation theorem or the 
Riesz convexity theorem (see [S], Section 9.3 and 0, Section VI. 10. 11) whenever 
6 G [0,1], 1 < po,Pi,9o,qi < oo and 

11-9 9 l_l-6i 9 

P Po Pi' q 90 qi 

then 

(2.24) w,Jn) < 2iw,,,p,{n))'-'{wg,,p,{n))'. 

In particular, using the obvious bound Wq-^^p-^ < 2 valid for any qi > pi wc obtain 
from (|2.24p for pairs {oo, 1), (2, 2) and (oo, oo) that for all 5 > p > 1, 

(2.25) ruq.p{72) < (2a(n))p"^ n7,^p(n) < 2^+p"^ (p(n))^" p + ^ 

and VJq^pln) < 2^^^ p {(j){n))^^ p . 
Wc observe also that by the Holder inequality ioi q > p > 1 and a G {0,p/q), 

(2.26) /?(g,r)<2i-"[/?(p,r)]"7^-t,, 

with 7e defined in (|2l^ . Thus, we can formulate Assumption 12. II in terms of more 
familiar a, p, </), and -^-mixing coefficients and with various moment conditions. It 
follows also from (|2.24p that if Wq^p{n) — >■ as n 00 for some q> p>l then 

(2.27) Wq^p{n) — 7> as n — > 00 for all g > p > 1, 

and so (|2.27p holds true under Assumption 12. II 

The key point of our proof will be construction of martingale approximations 
for the processes 'Ci,Af(^)'s where we will have to overcome problems imposed by 
strong dependencies between terms in the sum <\2.9\ . as well as between arguments 
X((7j(n)), i = 1,2, of the function F there. The realignment in the definition 
of {£,i,N{t)} for i < fc will also be important since it makes the collection a process 
with independent increments in the limit. Otherwise, in the limit, increments of 
will be correlated with the increments of {£,j{t)} at different time points. It 
will not matter for i > fc -I- 1, for they will all turn out to be mutually independent 
in the limit. 

The conditions of Theorem 12.21 hold true for many important models. Let, for 
instance, T„ be a Markov chain on a space M satisfying the Doeblin condition 
(see, for instance, [12], p.p. 367-368) and fj, j = !,...,£ be bounded measurable 
functions on the space of sequences x = (.t,;, i = 0,1,2,..., Xi € M) such that 
\fj{x) - fj{y)\ < Ce~°" provided x = (xi), y = [yi) and Xi = yt for all i = 
0,1,..., n where c, C > do not depend on n and j. In fact, some polynomial 
decay in n will suffice here, as well. Let X{n) = {Xi(n), ...,Xi{n)) with Xj{n) = 
fj(T„, T„+i, T„+2, ...) and take cr-algebras Tu, k < I generated by T^, T^+i, T; 
then our condition will be satisfied considering {T„, n > 0} with its invariant 
measure as a stationary process. In fact, our conditions hold true for a more general 
class of processes, in particular, for Markov chains whose transition operator has a 
spectral gap which leads to an exponentially fast decay of the p-mixing coefficient. 
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2.3. Remark. Formally, p.Sp requires some stationarity and, for instance, if we 
consider a Markov chain ^„ satisfying the Doeblin condition but whose initial 
distribution differs from its invariant measure then (|2.5p does not hold true for 
X{n) = /(Cn)- Still, a slight modification makes our method to work so that The- 
orem 12.21 (as well, as its continuous time version Theorem 12. 4p remain valid. In 
order to do this we consider another probability measure 11 on the space {n,J-) 
and require the weak stationarity (|2.5|) with respect to H, i.e. X{n)Il = fi and 
{X {n) , X {n' ))H ~ /i„_„/. In addition, we modify the definition of the dependence 
coefficient vjq^p in (|2.ip taking the conditional expectation of g there with respect 
to the probability P while the unconditional expectation of g taking with respect 
to n. It is easy to see that under the same assumptions as above but with modified 
()2.ip and (|2.5p our proof will still go through. 

Important classes of processes satisfying our conditions come from dynamical 
systems. Let T be a Axiom A diffeomorphism (in particular, Anosov) in a 
neighborhood of an attractor or let T be an expanding endomorphism of a 
Riemannian manifold M (see [3]), /j 's be either Holder continuous functions or 
functions which are constant on elements of a Markov partition and let X(n) = 
{Xi{n), ...,Xi^{n)) with Xj{n) = fj{T"'x). Here the probabifity space is {M,B,fi) 
where /i is a Gibbs invariant measure corresponding to some Holder continuous 
function and B is the Borel cr-field. Let C be a finite Markov partition for T then 
we can take J^ki to be the finite tr-algebra generated by the partition r\\^^T^C. In 
fact, we can take here not only Holder continuous fj's but also indicators of sets 
from J-ki ■ A related example corresponds to T being a topologically mixing subshift 
of finite type which means that T is the left shift on a subspace S of the space of 
one-sided sequences = (iJi, i > 0), q = 1, Iq such that G S if 7rj;;Q^i ~ 1 for all 
i > where H = (TTy) is an x Iq matrix with and 1 entries and such that H" 
for some n is a matrix with positive entries. Again, we have to take in this case fj 
to be Holder continuous bounded functions on the sequence space above, /j, to be a 
Gibbs invariant measure corresponding to some Holder continuous function and to 
define J^ki as the finite tr-algebra generated by cylinder sets with fixed coordinates 
having numbers from k to I. The exponentially fast V'-mixing is well known in 
the above cases (see [3]). Among other dynamical systems with exponentially fast 
i/j-mixing we can mention also the Gauss map Tx — {l/x} (where {•} denotes 
the fractional part) of the unit interval with respect to the Gauss measure G (see 
[To]). The latter enables us to consider the number Na{x,n), a = (ai, ...,a^) of m's 
between and n such that the qj (m)-th digit of the continued fraction of x equals 
certain integer aj,j = Then Theorem 12.21 implies a central limit theorem 

for Na{x, n) considered as a random variable on the probability space ((0, 1],B, G). 
In fact, our results rely only on sufficiently fast a or p- mixing which holds true for 
wider classes of dynamical system, in particular, those with a spectral gap (such 
as many one dimensional not necessarily uniformly expanding maps) which ensures 
an exponentially fast p-mixing. Of course, there are many stationary processes 
(including unbounded ones) and dynamical systems with polynomially fast mixing 
which still satisfy our conditions but they are more difficult to describe in short. 

Next, we discuss a continuous time version of our theorem. Our continuous 
time setup consists of a p-dimensional process X(t), i > on a probability space 
{^l,T,P) and of a family of cr-algebras Tst C J-, — oo < s < t < oo such that 
J-st C J-s't' if s' < s and t' > t. We assume that the distribution of X[t) is 
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independent of t and denote it by fj.. The joint distribution of {X{t),X{t + s)} is 
assumed to depend only on s and is denoted by fj.s- For all t > we set 

(2.28) ^q,pit) = SUpZUg^p{T-oo,s,J^s+t,oo) 

and 

(2.29) /3{p,t) = sup\\X{s) ^ E[Xis)\T,_t,s+t]\\p. 

s>0 

where vjq^p{G,'H) is defined by p.ip . We continue to impose Assumtion 12. II on the 
decay rates of ■Wq.p{t) and P{p,t). Although they only involve integer values of t, 
it will suffice since they are non- increasing functions of t . Let qi{t) < 92 (i) < 
• • • < qe{t) be increasing positive functions such that qi{t) ^ it for i ^ 1, k while 
qi{t), i > k grow faster in t. We assume that these functions satisfy the conditions 
(PTTTj) and (Pl^ (with t in place of n) while (P?TU|) is replaced by 

(2.30) lim {qi{t + 7) — qi{t)) = 00 for any 7 > and i > k. 

t— f 00 

2.4. Theorem. Suppose that Assumption \2. 1\ holds true. Then the distribution of 
the process 

(2.31) ^^(i)^ / F{Xiq^is)),...,X{q,{s)))ds 

V iV Jo 

on C[0,T] , converges to the distribution of a Gaussian process ^{t) which has the 
representation 112. 23\) but unlike in the discrete time case all processes rji, i > k 
are zero there while {?7i(t), 77fc(t)} is a k- dimensional Gaussian process having 
stationary independent increments. The means are and variances and covariances 
are given by E[j]i{s)rij{t)] = mui{s,t)Dij, i,j = 1, k. The expressions for these 
Di j are provided in Section\^ 

The conditions of Theorem 12.41 are satisfied when, for instance, X(t) = 
{Xiit), ...,Xp{t)) with Xj{t) = /j(Tt) where Tt either an irreducible continuous 
time finite state Markov chain or a nondegenerate diffusion process on a compact 
manifold. Furthermore, Ornstein-Uhlenbeck type processes X{t) produce a class 
of unbounded processes still satisfying our assumptions. On the other hand, these 
conditions do not usually hold true for important classes of continuous time dy- 
namical systems (flows) having rich probabilistic properties such as Axiom A (in 
particular, Anosov) flows where the standard tool of suspension flows is usually ap- 
plied while it does not seem to work in our circumstances and a different approach 
should be employed here. 

2.5. Remark. Under stronger mixing and moment conditions it is possible to derive 
convergence of all moments of (<) to the corresponding moments of the limiting 
Gaussian process ^(i). 

3. Approximation Estimates 

This section contains estimates which are crucial for our proofs while some of 
them may have also independent interest beyond this paper. We will make repeated 
use of the following simple variations of Holder's inequality. 
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3.1. Lemma, (i) For any two random variables Z,D 

provided ^ > ^ + jr. If, in addition, \D\ < \Z\ a.e. (almost everywhere), we can 
replace k by a < k and change h to h + k ^ a obtaining 

\\Z''D''\\a < \\Z^+''-°'D"'\\a < \\Z\\'i+''-°'\\D\\'^, 

provided i > ^'+^";~" + 

(a) If f{x,io) is a function of x and lu such that for almost allu, 

\f{x,L0)\<C{L0)[l+\x\^] 

then 

||/(xM,c.)|U<(i + 7,^J||CHI|p 

provided ^ > ^ + ^ where 7„i is a bound for \\X\\,n. 

(Hi) If f{x,Lo) is a function of x and uj satisfying for almost allui, 

|/(x,c.) - f{y,u)\ < Hiio)[l + \x\'^ + lyl'^Wx ~ yf 

then 

(3.1) - ./(l'H,^)||a < (1 + 2j^)\\H{uj)U\X - Y\\l 

provided ^ > ^ + ^ + | where "f„i is a bound for \\X\\,-n and \\Y\\m- 
Proof. For (i), by Holder's inequality 

\\Z^D''\\a= [EiZ'^'^D'"']]'' < 
provided ^ > + -pr . U \D\ < \Z\ and < a < k, 

\\D-Z% < WD'^Z'^+'^-^a < \\Z\\''Jl+^"'^\\D\\^, 

provided i > ''+^-'^ + ^. 

For (ii), by Holder's inequality 

E[\f{x{L,),Lor]<E[[ciu)r[i + \xn] 

< [E[[Ciu:)rp[E[[l + \X\'^]'^]]^ 

provided ^ > ^ + . 

The assertion (iii) follows similarly from the inequality 

E[\XYZ\]<\\X\\,,\\Y\UZ\U 

ifl^IT + i + i- ° 
We will need also 

3.2. Lemma, (i) Let F(xi, . . . , Xi-i, xg) be any function that satisfies \2.6\) and 
{2. 7p . Then the functions Fi(xi, . . . , Xi) defined in i2.18\} will inherit similar prop- 
erties from F. 

(ii) Let Z be a random vector in L^{P) with \\Z\\i^ < 7^ and Q <Z T be a sub a -field. 

If 

Gi[xi, . . .,Xi-i,u) = E[Fi{xi, . . .,Xt-i,Z{u!))\g] 

then 

\G,{xu. . . w)| < C(l + CiioY + \x\') 
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and 

\Gi{xi, . . . cj) - Gi{yi,. . .,yi-i,u)\ 

<C{l + CiLuy + \x\' + \y\^)\x-y\- 

where C > is a constant, C{uj) = (2£:[|Z|' |^;]) ' and \\C{uj)\\[ < 2Y^. 
Proof. For (i), if 

\F{xi,X2,...,X,)\<Cl{C2 + \x\') 

then 

1/ F{xi, . . . ,Xi-i, Xi)dfi{xi)\ < J \F{xi, . . . ,Xt-i,Xi)\d^j,{xi) 

<Ci{C2 + \x\^+Y.)- 
The Holder property is similar. 
The assertion (ii) follows from 

|G,(xi, . . . w)| < E[\Fixi, x,.i,Z)\\g] < CiE[{C2 + + \z\')\g] 
and 

\Gi{xi, . . .,Xi-i,u) - Gi{yi, . . . w)| < E[\Ei{xi,. . .,Xi-i,Z) 

-E,{yi, . . . Z)||g] < CE[{1 + \x\' + \y\'' + 2|Z|')|e] \x - y^. 

□ 

3.3. Remark. Here and in what follows it is sometimes more convenient to use 
together with ()2.6p and p.7p also slightly different looking conditions for growth 
and Holder continuity of functions we are dealing with (i.e. considering \x\'' in place 
of ^ G M^*^) but, in fact, these sets of conditions are equivalent since for 
any 6i, 62, > and 7 > 0, 

; I 

(3.2) max 6/ < V 6/ < Z max b] < Z(y < l^^'' max foj. 
i<i<i » - /-^ « - i<i<i ' - - i<i<i * 

i=l 1=1 

Wc will need the following result which will serve as a base for our estimates 
and is, in fact, an extended multidimensional version of the standard Kolmogorov 
theorem on the Holder continuity of sample paths. 

3.4. Theorem. Let f{x, lj) be a collection of random variables defined for x G R'^, 
satisfying 

(3.3) \\f{x,Lo)-f{y,u)\\p < Ci{l + \x\' + \yn\x-yr and \\f{x,oj)\\p < C2{l + \xn 

with K > ^ . Then for any t' > t + ^ and 6 such that k > 6 > ^ there is a random 
variable G{uj) such that 

(3.4) |/(a;,w)| < G(w)(l + |a;|'') a.e. with \\G{u;)\\p < co[Ci + Cz]^^ cl~^ 

where cq = co(d,p, k, 0, (,') > depends only on parameters in brackets. Since 
K < I and pK > d, it follows that p > d, and therefore we can always take l' — t + 1 • 
Furthermore, if Z € Lm{P) is a random variable with values in M."^ satisfying 
\\Z\[,n andif\>\ + ^ then 

(3.5) \\f{Z{u),u)\\a<\\G{Lu){l + \ZY+^)\\a 

< Co[Ci + C2]^Cl~^[l+ji+^] = Coc(7,n)[Ci + C2]^Cl'^. 
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~ S) > d, then we can have an almost sure Holder estimate 

with 

\\H{L0)\\p<ciK,9,d,p, S, i) (C1+C2) 

and the estimate 

(3.6) ||/(Xi,X2,...,X,„i,C^)-/(yi,y2,...,>^.-l,C^)||a 

< \\H{^)[l + \XY+^ + \YY+^]\X-Y\% 

<\\HUi + i'^')T.T=\\\^j - 

provided i > i + i±2 + I where X = (Xi, ...,X,_i), Y = (Fi, ...,r,_i) S 
Xj,Yj, j = 1, ...,i — 1 are random vectors with \\X\\m, ||^||m < 7m- 



and 



3.5. Remark. There are several types of constants that we need to keep track of. 
Constants C, K will be absolute and may change from line to line. Constants c will 
depend on other parameters like moments and will be denoted by c(-) to indicate 
this dependence. 

Proof. For t' = i + 1 > t + I set 

/>,w) = /(x,w)(i + N'+i)-i. 

Then by if |a; - y| < po = ^, 

(3.7) Wfix.u) ~ /(y,c.)|lp < |l/(x,c.) - /(y,c^)|lp(l + |x|'+i)-i 
+ ll/(y,^)llp||y|'+' - \x\^^%{x) < ci[Ci + C2]\x - yl^r^ix) 

and 

(3.8) \\f{x,u;)\\,<C2riix) 

where 77(0:) = (H-|a;|'')(H-|x|'''*"^)~^ and ci =Ci(t, k, d) < 00 is a constant depending 
only on the parameters in brackets. Let B^ip) denotes an open unit ball of radius 
p centered at w gM."^. A multivariate generalization of a result of Garsia, Rodemich 
and Rumscy (see [16], p. 60]) states that if g : ^ M satisfies 



for some continuous strictly increasing functions \I',(T with cr(0) = ^(0) = then 
for any x,y e Bu,ip), 



2\x-y\ _^^4d+lQ 



(3.9) \g{x) - g{y)\ < 8 / ^'^( , T,l da{u) 

Jo r^dU 

where kd ~ inf „eB„(p) l-S°(")n-Bo(i)| ^ Choose here ^{z) — \zV' and aiu) — u^^^ 
with <9 < K- - and set 

[Qn,A^)f = / 1^ .Ape+2d dxdy. 
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Then by the result above together with p.7|) we derive that there exists C2 = 

C2{i, l' , K,9,p,d) > such that for any x,y £ Bw{p), 

(3.10) |/>,t^)-/(y,w)| <C2g^„,pM|x-2/|« 
and for < p < POj 

(3.11) Wu^Ap < C2Vd{Ci + C2)v{w)p^^-'^ 
where 

vP^= [ \x-y\''P-P^-^'^dxdy <oo 

Jbo{1)xBo{1) 

provided p{n — 6) > d. Observe that (|3.10p and p. lip is, in fact, the conclusion 
of a multidimensional version of the Kolmogorov theorem (sec, for instance, [15j . 
Theorem 1.4.1) but our argument relies also on the specific estimate (|3.1ip . 

Let li'l be the lattice in Mf^ with spacing h. The maximum distance of any point 
in M'' from is = hpQ. Therefore in the cube of side h centered around 
w e we have 

|/(X,W)| < \ f{w,Uj)\+C2Q^.hpo{uj)p'oh'', 

and so 

|/(x, u;) r < 2P-'[\fiw, u:) ^ + c^Q^^.^^ {u:)f^,'hP'] 

Therefore, 

sup |/>,c.)r<2P-i sup [\~f{w,LoW + clQl^^^^{u:)pl\^% 
<T-' [\~f{w,u:W + c^,Ql,^^^{u:)pl\^'] 



and, using (|3.1ip together with the estimate X^mez'' — (^{d,i,p)h 
£;[[supR. \hx,u;)\P]] < 2f-iE„ezf, 

< + (Ci + c^rhp-] Eu.eztivHr < [c^f + ici + c^rhP'^jh-^ 

with a constant C5 — c^{d,p, t, k, 0) > 0. Making the choice of 



i?[[sup|/(x,c.)|P]] < cfCr^Pi +C2]^ 

Now set 

$(cj) = sup \f{x,uj)\. 

Then 

|/(x,c.)| <$(c.)(l + 1x^+1), 

and so 

|/(Z(c.),c.)|<<i>(c.)|(l + |Z(c.)r+i). 

These yield p.4p and p.Sp follows by a routine application of the Holder inequality 
(see Lemma [3?T|l . 



Nonconvontional limit theorems 



13 



We now proceed to obtain a Holder estimate on f{x,u!). If — 6) > d then by 
p.lOP and in the same way as above for x,y in a cube of side 1, 

\f{x,Lo)~f{y,Lo)\<Cs{cj)\x~y\' 

with ||C5(a;)||p < c{K,d,S){C\ + C2). For such a cube D centered at z we obtain 
that 

\f{x,iu)- f{y,iu)\<Cs{z,iu)\x-y\' 

with 11(75(2, w)||p < cj{K,d,6,L){l + |z|'+^)(Ci + C2). It follows that whenever 

\x-y\< 1, 

1/(^,0.) - f{y,io)\ < C*H[1 + |xr+i + \yr']\x - yf 

where ||C*||p < C8(k, d, (5, t)(Ci + C2). Then for some il{uj) = cg((5, t)C* (w) we 
obtain the global estimate 

for all x^y. In particular, by Lemma l3.ll 

||/(Xi,X2,...,x,_i,c^)-/(yi,y2,...,K,_i,c^)IU < ||i/H[i + |x|'+2 

+iri'+2]|x - rnu < iiffiip(i + 7^+') e;=i 11^. - 

provided i > i + + ^. □ 

In our nonconventional setup Theorem 13.41 will be applied in the form of the 
following useful result. 

3.6. Corollary. Let Q and Hi C "^2 be a-subalgebras on a probability space 
{fl,J-',P), X and Y be d-dimensional random vectors and fi ~ fi(x,uj), x g 
K'', i ^ 1,2 be collections of random variables that are measurable with respect 
to Hi, i = 1,2, respectively, and satisfy 

(3.12) \\f^{x,co) - f^{y,io)\\, < Ci(l + \x\' + {y^x - y^ 

and \\f,{x,u;)\\,< 02(1 + \x\'). 

Set fi{x,uj) = E[fi{x, ■)\G]ii^) and gi{x) = E[fi{x,uj)]. 

(i) Assume that q>p, 1> k> > ^ and ^> ^ + Then for i = 1,2, 

(3.13) \\f,{X{uj),uj) - g,{X)\\a < cWg.p(g,m){Ci + C2)^&i^{l + \\X\\'+^). 

where c = c{l, k, 9,p, q, a, S,d) > depends only on the parameters in brackets, 
fa) Next, assume that i > i + ^+2 + A. Then for i = 1,2, 

(3.14) \\E[f,{X, -m - g.,{X)\U <R + 2c(Ci + C72)(l + 2\\Xr+^)\\X - E{X\g]\\l 

where R denotes the right hand side of iS.lS]) . 

(Hi) Furthermore, let x = {v,z) and X = (V,Z), where V and Z are di and 
d— di- dimensional random vectors, respectively, and let fi{x,u)) = fi{v, z,Lij) satisfy 
inx={v,z). Setgi{v)^E[f,{v,Z{uj),Lo)]. Then for i =^ 1,2, 

(3.15) \\EmV, Z, - UV)\\a < c (1 + IIXII^:) 
x(n7,,p(^,H.)(Ci + C2pcl''^ + \\V - E[V\g]\\l + \\Z - E[Z\'H.]\\l). 
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(iv) Finally, for a,p,q, L,m,S satisfying conditions of (ii), 

(3.16) \\Mx{lu),lu) - /2(rH,c^) - gi{X) + g2{Y)\\a 
< cw,AG,n2){l + \\X\Y+^ + \\Y\\\r^)\\X Y\\l 

where c — c{l, k, O^p, q, a, S,d) > depends only on the parameters in brackets. 
Proof (i) Set h{x,uj) = fi{x,uj) - gi{x), 

Ki ~ CiVjq^p{Q,'Hi) and K2 = C2VJq^p{Q ,'Hi). Then by p.l2p and the definition 
of TJDq^p for all x,y and q,p > 1, 

(3.17) \\h{x,uj) - h{y,uj)\\p < mq^p{g ,ni)\\ft{x,uj) - Ji{y,uj) - gi{x) + gi{y)\\q 

<2K\{l + \x\' + \yn\x-yr 

and 

(3.18) \\h{x,Lu)\\p < ujq^p{g,U,)\\f,ix,Lj) - g,{x)\\q < 2K2{1 + |xr). 

These inequalities enable us to apply Theorem 13.41 to h{x,uj) (in place of f{x,uj) 
there) and p.lSp follows from p.Sp . 

(ii) Note that since 1 > | it follows that fi{x,uj) has an almost surely continuous 
modification and taking into account that X = is C/-measurable we obtain 
that E[f,iX, ■)\g] = /,(!, •). Therefore 

(3.19) \\E[f,iX,■)\g]-g,{X)\\a<\\E[f,{X,■)\G]^g^{X)\\a 

+\\E[f,{x, ■)\g] - E[f,{x, ■)\g]\u + \Mx) - g^{x)\\a 

< WfdX, •) - g,{X)\\a + \\f,{X, •) - f^{X, OIU + \\9^{X) - ft(X)|U. 

We can estimate the first term in the right hand side of (|3.19p by p.l3p . with X 
replacing X and noting that < The second term is estimated by 

(EH), 

(3.20) \\f^{X,CJ) ~ f^{X,L0)\\a < cC,{l+Yr,t')\\X - Xf^. 

The third term is easily estimated taking into account that by (j3.12p and Lemma 

\g.ix)~gdy)\<c[l + \x\'' + \yn\x-yr 
and since < 6 < k < 1, it follows from Holder's inequality that 

\\g.iX)-g,iX)\U<cil + ji+')\\X-X\\l. 

(iii) Set V - E[V\g], Z = E[Z\n], Uv) = E[f,{v,Z,-)] and U^) = 
E[f,{v,Z,-)]. Then 

(3.21) \\Emv, z, ■)\g] - uv)\\a < \\f^iv, z, •) - /,(y, z, oiU 

+ \\E[f,{V,Zr)\g]~UV)\\a + \\UV)^~g.,iV)\\a. 

The first term in the right hand side of (|3.2ip is estimated by p.6p similarly to 
(|3.20p . Observe that fi{v, Z, •) is ?^i-measurable, and so we can estimate the second 
term in the right hand side of p.2ip by p.l4p with V, di, fi{v,uj) and gi{v) in place 
of X, d, fi{x,uj) and gi{x), respectively. The third term in the right hand side of 
p.2ip is estimated by first using p. 121) to obtain 

\Uv) - Uy)\ < EUiv, z, .) - f,{v, z, .)|] < E[{i + H + \z[ + \z\-)\z - zn 

and then substituting V in place of v there. 
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(iv) Set h{x,u) ^ fi{x,u!) - f2{x,uj) - gi{x) +52(2;), 
Ki = CiWq^p{Q ,'H2) and K2 = C'2^^(j,p(^/, ^2)- Then by p.l2p and the definition 
of Wq^p for all x,y and q,p > 1, 

(3.22) \\h{x,uj) - h{y,uj)\\p < n7g^p{g,n2)\\fi{x,uj) ~ fi{y,uj) - gi{x) + gi{y) 
-/2(.T,c^) + f2{y,u:)+g2{x) - g2(2/))||, < 2A-i(l + + \yn\x - y^ 

and 
(3.23) 

\\h{x,Lu)\\p < Wq^p{g,H2)\\.h{x,Lo) - f2{x,uj) - gi{x) + g2{x)\\q < 2X2(1 + \x\'). 
Now ((X^ and enables us to apply ((^ which yields ([XTO)) . □ 

3.7. Remark. We will always work with a,m,p,5,q that satisfy p{k ~ 6) > d ~ 
{£ — 1 ) p and 

.o^.N 1 1 i. + 2 (5 

3.24 - > - + + - 

a p m q 

Note also that m > and m > iiiii^. 

4. Limiting covariances 

Here and in what follows we set li^g.(„) = Fi{X{qi{n)), . . . ,X{qi{n))) 
and li^rn = if m 7^ <?^(?^) for any n. Let i^i^„_r(a;i, 0:2, . . . , a;,;_i, w) = 
E[F{xi,X2, ■ . ■ ,Xi-i,X{n))\Fn-r,n+r] and Xr{n) = E[X{n)\Fn-r,7i+r]- We denote 
also l^;,,.(„),r = -Pj,g,(ri),r(-'^r('7i(")), ■ • . , (^i- 1 (n) ) , w) and Fi,™,,. = if m 7^ qi{n) 
for any n. 

In this section we will study the asymptotical behavior of covariances 

Aj(A^,s,t)-i?[6,Ar(s)^,,jv(i)] = ^ ii;K,,,(„)r,,,^(i)] 

l<n<Ns l<l<Nt 

of the processes {£,i,N(t)} defined by (|2.2ip and (|2.22p . We will show that the limits 

D,j{s,t) = lim Dij{N,s,t) 

N^oo 

exist and Dij{s,t) = min(s, t) Z?i_j where the matrix {Di j} is determined by the 
results below. 

4.1. Proposition. For any i,j ~ l,2,...,fc and s,t>0 the limit 
lim £;[C..JV (5)4^(0] = 

lim 1 Y E[F,{X{n),X{2n),...,X{tn))F,{X{l),X{2l),...,X{jl))] 



0<in<Ns 
0<jl<Nt 



exists and equals Di_j min(s, t) which is calculated as follows. Let v be the greatest 
common divisor of i and j with i — vi' , j ~ vj' and i\j' being coprime. Set 



: ^2i' : ■ • ■ 7 -^vi' 7 Vj' ; U^j' • ■ • 5 y^>j' ) J {p^l 5 ■ • ■ 5 ^i— 1 7 ) 

X Fj{yi,...,yj_i,yj) J| dfi{xa) ]J dfj.{ya') 

u<f{i',2i\...,vi'} a'(f{j'.2j\...,vj'} 
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and 

(4.1) ai,j{ni,n2, ...,n^)= / . . . ,x.u,yi, . ■ . ,yv)Y\_ dlJLn,{x„,ya). 
Then 

oo 

' y 

— oo 

aij(0, 0,...,0) = / . . . ,a;„,a;i, . . . ,a:^,) J]^ d/i(a;cr) 

and the series for Di j converges absolutely. 

This is essentially a straightforward but long computation carried out in a few 
steps, each one formulated as a lemma. We will first derive some uniform bounds 
on Di^i{N,t,t) A key step is to get for any pair i,j an estimate on 

If \n — l\ » 1 then either qi{n) or qj{l) will be much bigger than all other qi{m) 
and qj{m) which together with the mean condition on Fi,Fj and estimates of 
Section [3] will make then this expectation small as shown in the following result 
which will be used also later on. 

4.2. Lemma. There exists a nonincreasing function h{m) > 0, 
with J2m=i h{rn) < oo, such that for any i, j = 1, 2, ...,£, 

(4.2) sup \b^j{nj)\ < h{m) 

where Si,j{n,l) = max(sij (n, Z), Sj^i(Z, n)) and Si j{n,l) = min{qi{n) — qj{l), n). 
Furthermore, there exists a constant C > such that for all t > s > and i = 
!,...,£, 

(4.3) sup £;|6,jv(0 - 6,iv(s)P <Cit- s). 

N>1 

Proof. First, observe that for i ~ 1, fc, 

(4.4) qi{n) — qi_i{n) ^ n and ^(n, Z) = min(i|n, — /|, max(r7,, /)) > |n — /| 

where in the first equality we set qo{n) = 0. On the other hand, if i > fc + 1 then it 
follows from (|2.10p - (|2.12p that for any e > there exists such that for all n > 
and n > I > 0, 

(4.5) qi{n) ~ qi^i(n) > n + , qi{n) - qi(l) > n - I + , 
and so 

(4.6) Si^i{n, I) > min(n — / + , n) > n — I. 

Now, assume that qi{n) — qj{l) > and n > ni so that we will use here (|4.4p - 
(|4.6p with £ = 1 while only in Proposition 14.51 these estimates will be needed for 
all positive e. Set r = ^Sij{n,l) = ^Sij{n,l). If we replace and Yj g.f^i-j by 

^i.(3i(n),r Siiid Yj,qj{i),r defined at the beginning of this section then the difference 
between bij(n,l) and 
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can be estimated easily using Corollary 13. Gf iv) with 'H2 = ^ which gives 



\}l:pAn,l)-b,,j{n,l)\ < c(7™,7Mi±i))[/3(9,0]'- 



2-pQ 

On the other hand, by (|4.4p and (|4.5p we see that in our circumstances min((7i(n) - 
qj{l),qi{n) — qi-i(n)) > Sij{n,l), and so by Corollarv lB.Gf i). 

\b'(j{n,l)\ = |-By,,g,(„),r>"j,g,(0,r| 

= |£;[i?[r,,,,(„)^,|j-o,,.(„)_,]r,,,^(z),,]| < ||f;(x,(gi(0),...,x,(9,(0))lU,(P) 

x||-E'K,9,(n),r|-^0,(?,(ri)-r]||L2(P) ^ C'ro^^p (i Si j (n, /) ) . 

We can always estimate \bij{n,l)\ by \b'fj{n,l) — bij{n,l)\ + \b'fj{nj)\, so that 

\b,^j{n,l)\ < C(Ti7,,p(is,,,(n,/)) + [/3(q,is,,,(n,0))0- 
Now, observe that if n < ni and qi{n) — qj{l) > then 

Sij{n, I) < Li ~ max qi{n) and I < ni + Li. 

' n<ni , 2<^! 

Hence, in order to satisfy ()4.2p we can take 



h(m) ~ max 

0<ri,;<?ii+Li, l<i,i<£ 



for m < Li while for m > Li we define 



M™) = CKp([im]) + (/3(q, [im]))*) 



Finally, by (g^]) and (gj]) for f > s > 0, 

s<i<Nt + 2 ^ Ns^i<Nt \bi^i{n, 

< J! ENs<i<Nt {EY^j + 2 E„>;+i Hn 0) < Ct 
provided N{t — s) > 1 and the result follows. □ 

Next, we will need a result which will be formulated in a somewhat more general 
situation. Let H{xi,X2, ■ ■ ■ , xj) be a function on that is continuous and satis- 

fies the growth condition \H{xi,X2, ■ ■ ■ , Xd)\ < l + X^i ll^^ill' some t > 1. Suppose 
that {Y(n) : n > 1} is a stochastic process with values in R'^ and there exists an 
integer m > 1 such that for any I < m the distribution of {Y{ni), Y{n2), ■ ■ ■ Y{ni)} 
depends only on the spacings {n^ — rii-i}, I — 2, between them. For I > 2, we 
denote this distribution by us where S is a set of Z — 1 positive integers prescribing 
the spacings between the / integers. We assume that all {Y{n), n > 1} have a 
common distribution ^ and that the integrability condition J ||a;||'(i/i < 00 holds 
true. For some p,q > I and a nested family of sub cr-ficlds J-m,n as above assume 
the mixing condition 

^q,pil) ~ sup n7g^p(J"_oo,m, -^n,oo) — > aS l^CO, 
rn—n>l 

and the localization condition 

lim sup \\Y{n) - E[Y{n)\Tn~r,7i+r]\\Li(p) = 0- 

Let Hi < 712 < . . . < TT-d be a sequence of integers that tend to 00 with some of 
gaps {n.i-|_i — Hi} tending to infinity while others are kept fixed. This splits the set 
of integers 1,2, ... ,d into a partition V consisting of blocks Bj of different sizes. 
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The pairwise distances between integers in each block Bj remain fixed (so it can be 
viewed as rigid) while the distances between different blocks tend to oo. We assume 
that each block Bj consists of at most m integers. Let mj denotes the number of 
integers in a block Bj and Sj denotes the set of spacings in Bj, i.e. sequence of 
•nij — 1 positive integers representing pairwise distances between successive integers 
in Sj. Let the distribution fi-p on {R^Y be the product measure 

over successive blocks. 

4.3. Lemma. Assume that {rij} goes to infinity with rigid blocks determined by V. 
Then 

lim E[H{X{ni), X(n<j))] = / i/(xi, . . . , Xd)d^iv 

where the limit is taken so that the sets Sj of spacings in each block Bj remain fixed 
while the gaps between different blocks tend to infinity. 

Proof. First we note that because of the growth and intcgrability conditions we can 
replace H by H(j) where </) is a continuous cut off function with compact support. 
The error is uniformly controlled on either side. We can then approximate H 
uniformly by a smooth function. In other words we can assume without loss of 
generality that H is a bounded continuous function supported on some ball of 
radius L with a bounded gradient. We prove the lemma by reducing the number 
of blocks by one at each step. The last gap that tends to oo cuts off a block 
B = {ud'+i, ■ . . ,nd} at the end with a rigid spacing S between integers in the 
block. We will show that 

(4.7) E[H{X{ni), . . . , X{nd))] = 

-P fixed 

where 

H{xi,X2, ... ,Xd) = H{xi,X2, ... ,Xd) 

-/ H{xi,X2, . ■ .,Xd',Xd'+i,. . .,Xd)dfj,s{xd'+i, ■ ■ ■,Xd). 
This will reduce the number of blocks by one, replacing H by 

Hi{xi,X2, . . . ,Xd') ^ / H{xi,X2, ■ . . ,Xd',Xd' + l, . ■ . ,Xd)dfis{xd' + l, ■■■,Xd). 



The step by step reduction will end when only the first block Bi with spacings 
Si remains and since it is rigid we can integrate it out with and end up with 
/ H{xi, . . . , Xd)diJ,-p which will complete the proof of the lemma. 

The function H is also bounded with a bounded gradient. Therefore, 

\\H{Xini), . . .,X{nd)) - H{Xr{ni), . . .,Xrind))\\ 
<Csup||X,(n)-X(n)|U,(P) ^0 



uniformly over all ni, . . . , as r ^ oo. To establish (|4.7p . it is therefore sufficient 
to prove that 

(4.8) lim limsup E[H{Xr{ni), . . . , Xriud))] = 0. 
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Observe that 

^E[Gr{Xr{ni),...,XrM,i^)] 

where 

To prove ()4.8p is clearly sufBcient to show that 

lim i?[ sup |G'r(xi, . . . , Xd', = 0. 

XI,. ...Xj^, 

Since ||VxGr||oo < ||Va;iJ||oo < |lVa;-ff||oo, there is a uniform bound on ||VG,.||. We 
can therefore estimate 

sup \Gr{xi,...,Xd',L0)\<C \Gr{xi,...,Xd',Uj)\dxi---dXd'. 

Xi,...,Xj, J 

Taking expectations and observing that Gr vanishes outside a ball of radius L, 

E sup \Gr{xi, . . . ,Xd',Uj)\ < C L'^ sup E\Gr{xi, . . . ,Xd' 

X\,...,X^/ Xi ,X^/ 

If Ud'+i — Ud' > 2r then by the definition p.ip of the dependence coefficients m, 
sup ||G'r(xi, . . . ,Xd',uj) - Hr{xi,. . . ,a;d')||i < 2 n7oo,i('^d'+i - Ud' - 2r)j|iJ||oo 

xi,...,x^, 

where 

Hr{xi, . . .,Xd') = E[H{xi, . . . ,Xd',Xr{nd' + l), ■ . .,Xr{nd))] 

while 

H{xi,. . .,Xd') = E{B{x^,. . . ,Xd',X{nd'+i), ■ ■ .,X{nd))] = 0. 
Since H has a bounded gradient, 

\E[H{xi, . . . ,Xd>,X{nd'+i), ■ ■ .,X{nd))] - E[H{xi, . . .,Xd', 
Xrind'+i),.. .,Xr{nd))] \ < Caup„E\X{n) ~ Xr{n)\ = e(r) as r ^ oo. 

Taking into account that OToo.i(0 ^p.q{l) ^ the lemma follows from the above 
estimates. □ 

4.4. Lemma. For any i,j<k and > and integer u, the limit 

/A n\ 1- 1 > / wmin(s,<) 

(4.9) im - }^ b,,,{n,l) = ^^c,,,(w) 

0<in<Ns ^ 

0<jl<Nt 

in-jl = u 

exists where v is the greatest common divisor of i and j . For any multiple ofv, 

(4.10) Cij{vu) = ai.j(u, 2w, uu) 

with ai_j defined by If u is not a multiple ofv then Cij{u) — 0. Furthermore, 



ii\ 1- ^ sr^ L f i\ umin(s,t) ■r-^ 

0<in<JVs -00<M<00 
Q<jl<Nt 

amd the series in the right hand side converges absolutely. 
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Proof. It is clear that if u is not a multiple of v there are no solutions of the equation 
in' — jV = u so we can replace u by vu. Combining the indices n, 2n, . . . ,in and 
I, 21, . . . ,jl and ordering them into a single sequence we obtain employing Lemma 
EJthat 

lim „,i^oo = lim ,>,i^oc, E[F.,{X{n), X{2n), . . . , X{in)) 

in-jl = vu ' in-jl = vu 

xFj{X{l), X{21), X{jl))] = a,,,j{u, 2u, . . . , vu). 

If V is the greatest common divisor of i and j then i = va and j = v/3 with a and 
/? being coprime. Since all the gaps in either sequence above go to oo, we can have 
blocks of size more than one only by pairing two members from different sequences 
and therefore the rigid blocks of Lemma 14.31 can be of size one and two only. If we 
start with {n,l) such that an — /3l ~ u, their multiples (amn, 13ml), m = 1, ...,v 
with amn — /3ml = mu will give v blocks of size 2. There can not be any other. 
Indeed, if (a, b) is a pair of integers which is not an integer multiple of (a, /3) then 
taking into account that a and /3 are coprimes we conclude that \an — bl\ — >■ oo 
when n oo preserving an ~ j3l = u fixed. To complete the proof of the lemma 
we need to count the number of integer solutions of in — jl ~ vu or an ^ (31 ~ u 
with avn < Nt and f3vl < Ns. The set of solutions for any u is obtained by 
shifting the set of solutions of the homogeneous equation an — (31 = by a fixed 
solution of the above nonhomogeneous one. Therefore, with our constrains their 
numbers can differ at most by a constant. In the homogeneous case the solutions 
are precisely those m = in = jl that are multiples of wa/3. Their number is integral 
value of ^"^if'^ = ^""g^'-*^ This proves glD while Lemma and glD 
imply (|i?TT|) . □ 

Finally we turn to ^i.Ar(i) with k + 1 < i < I. We will see in the next section 
that, in fact, their limits in distribution i > k + l} are mutually independent 

processes which are also independent of the processes {r]i{-);l < i < k} but here 
we deal only with their variances and covariances. 

4.5. Proposition. For i > k + 1, 

(4.12) limN-,ooE{C.,N{s)^z.Nit)) 

= min(s,i) / {Fi{xi,X2, ■■ ., Xi)) dfi{xi)dn{x2) ■ ■ ■ dfi{xi). 
Moreover, for any t, s and j < i, i > k, 

(4.13) lim E{C^.NmJ.N{s)) ^0. 

Proof. It follows from that 

Si^i{n,l) > min{\n ~ l\ + e^^ ,'max{n,l)) if max(n, Z) > and n^l, 
and so by (|421) . 

hi,i{n, I) Q as max(n, I) ^ oo so that \n — l\> 1. 
Therefore for any fixed L > ni, 

limSUpjv^^ ^ El<n,l<TN,n^l ^4^,1)1 < 2rErn>L H^) 

+ limsupjv^^ -^Ei<J;-^i£^ \bi.i{n,l)\ = 2rX;„>L /l("^)• 

We now let L — > oo and since h{m) < oo it follows that lim sup in the left hand 
side above equals zero, i.e. the off-diagonal terms do not contribute in (|4.12p . It 
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remains to deal with the diagonal terms bi^i{n,n). Since qj{n) — qj-\(n) — > oo for 
j = 2, 3, £ as n — > oo it follows from Lemma l4!3l that 

(4.14) lim bi^i{n,n) = / (Fi{xi, ...,Xi)Ydn{xi)...d^j,{xi) 

n— >-oo J 

proving (j4.12p . 

Next, we deal with (|4.13p . Relying on Lemma l42l we can estimate for any e > 0, 

(4.15) m^Nmj,N{s)\ 

< \E^,^Ni£mj,N{s)\ + |-B(e,,Ar(t) - ^^^Ni£T))CJ^Nis)\ 
— CTy/e+ Jj J26NT<n<NT,l<l<NT 

Since i > j and i > k then by (|2.12p we can choose N{e) > e^^T^^n^ such that 
Qiin) — qj{l) > s^^ whenever N > N{e), n > eNT, I < NT and, moreover, by 
(031), 

Sij{n, I) = mm{qi{n) - qj{l), n) 
> min(g,(7i) - qi{eNT) + e-^,n) > mm{n - eNT + e^^ ,n). 

Hence, 

^ J2 h{s,,,[n,l))<T 

eNT<n<NT,l<l<NT m>-min{e-KeNT) 

and letting, first, N ^ oo and then £ we derive (|4.13p from (|4.15p . □ 

5. Proof of the main theorem 

The proof of Theorem 12.21 relies on martingale approximations and martingale 
limit theorems but we will need several modifications in our situation. We begin 
with the following result which can be found in various forms in the literature (see, 
for instance. Section 2 in Ch. VIII of [13] and close versions in Theorem 18.2 in 
[2] and Theorem 4.1 in [H]). Let {UN,n : > 1} be a triangular array of random 
variables satisfying the following conditions, 

Bl. {Un.v,} is adapted to some {^In ,GN,n, Pn)] 

B2. {Un.u} are uniformly square integrable; 

B3. ||£'[J7jv,Tn|5Af.?i]||2 < c{m — n) for all N, n < m and for some sequence c(fc) 
satisfying J2T=o '^i^) = C < oo. 

B4. For some increasing function A{t), 

l<n<Nt 

where 

,m\G N .n-l\ ■ 

??i>n+l m>n 

Observe, that Wn.u, n > 1 is a martingale differences sequence provided B1-B3 
hold true. 



22 



Yu.Kifer and S.R.S.Varadhan 



5.1. Theorem. Under assumptions B1-B4, 

^ l<n<Nt 

converges in distribution on D[[0, T]; R\ to a Gaussian process ^(t) with independent 
increments such that ^{t) — ^(s) has mean and variance A(t) — A(^s). 

We need however to strengthen the theorem a httle bit in our context. First we 
note that the condition B4 can be replaced by the weaker condition 

(5.1) lim ]- ^[^^."] = ^(^) 

l<n<Nt 

as can be seen from the following result. 

5.2. Lemma. If for a fixed I the random variables 

Vn.t = Cl2r{i-i)+i<n<ri U N ,nY Satisfy a uniform law of large numbers in the sense 
that 

1 

lim sup sup [I - V \VN,n+j - E[VN,n+j\] I] = 0, 
J = l 

then i5.1\) implies B4. 

Proof. We begin with the observation that ii rjn, n > 1 are martingale differences 
adapted to any filtration Qn and they are uniformly integrable, then ^n=i Vn ^ 
in Li(P). To see this, we approximate rjn in Li{P) by fin that are uniformly 
bounded. The latter may not be a martingale difference but it can be written as 
rjn = rjn + fjn with ||j?n||Li(P) < Wvn - Vn\\ Li{p) and rjn being a martingale difference 
with a uniformly bounded second moment. We will now compare 

n<lNt] 

with block sums over Br = {n : rl + 1 < n < {r + 1)1}, 



A 



r:BrC[0,Nt] neBr- 

The difference involves the cross terms 

2 

r:BrC[0,Nt] ^">^^^ 

It is easy to see that the sum 

E 

is a martingale difference adapted to Qri and therefore for fixed I, 
lim - Ajv(i,cj)|U,(p) = 0. 

Since E^[A]sr{t,uj)] — i?-^[A5y(t, oj)], it follows immediately that 
limsup^r_^oo \\AN{t,i^) - E^[AN{t,uj)]\\L^i^p) 
< limsupjv^^ \\A'j^{t,uj) - EP[AN{t,uj)]\\L,(p). 
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On the other hand, WN,n = UN,n — RN,n~i + RN,n, where 

RN,n = J2m>n+1 E[Un ,m\G N,n], and 

By our assumption the squares of the block sums Vjv.r = iJ2neB ^N^nY satisfy a 
uniform law of large numbers in Li{P). The differences between the two block sums 
come from the correction term and their second moments are uniformly controlled. 
Therefore their contribution is at most y. Hence, 

limsuplimsup \\A^j^{t,Lo) — i?"^[^7v(i,'^)]!lLi(P) = 
and the lemma follows. □ 

5.3. Remark. Let the filtration Fm,n satisfiy any mixing condition, i.e. Wp^q{k) ^• 
as fc — >■ oo. Then any collection of uniformly integrable random variables {/„(w)}, 
with /„ being Tn+k,n-k measurable for some fixed fc, are easily seen to satisfy the 
(centered) law of large numbers. It is obvious for uniformly bounded {/«} and we 
can always approximate our uniformly in Li by uniformly bounded ones. 

5.4. Corollary. // we have a family of triangular arrays and the conditions of 
Theorem ] 5. 1\ are valid uniformly over the family then the limit theorem is also valid 
uniformly over the family. 

Proof. The proof is by a routine contradiction argument. If the family is indexed 
by a and the limit theorem is not valid uniformly, then for some choice that 
depends on N the limit theorem fails to hold. But this is just another triangular 
array and, by the uniform validity of the assumptions, the limit theorem has to 
hold. □ 

5.5. Remark. One way to generate new triangular arrays for = 1, 2, ... is to take 
a sequence of sub cr-fields, QN,kN^ a sequence of sets _Bjv <= QN,kN with Pn{Bn) > 
S > and to consider (flw, ^at,™, C/Ar,„, Pat.Bn), n = 1,2, ... where gN,n = GN,kN+n, 
Un.u = UN.kN+n and the measure Pn,Bn is defined by 

Pn{TC^Bm) 

It is easy to see that C/„ are again martingale differences, for each fixed 5 > 
uniform integrability under Pn.Bn is inherited from the same property under Pjv 
and the condition B3 of Theorem 15.11 holds uniformly over this family, as well, 
provided < CN for some C. Otherwise, it has to be checked again. The limit 
A{t) will of course vary depending on the behavior of If — > to then A{t) 
gets replaced by A{t + tp) — ^(^o)- 

This observation leads to the following theorem. 

5.6. Theorem. Let X he a complete separable metric space and for each N > 1 
let Fn{ll:) be a X -valued and Qf^^kj^- measurable random variable. Suppose that the 
distribution Atv of Fn under Pjv converges weakly as N ^ oo to X on X and 
^ — >■ to . Let the conditions of Theorem 15. il hold true and set 



kN-\'l<n<kN-\-Nt 
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Then the joint distribution of the pair (i^w, ^Ar.fc^ (•)) converges on X x D[Q^T] to 
the product of A and the distribution "f of a Gaussian process with independent 
increments having mean and variance A{t + to) — A(to)- In particular, any limit 
in distribution of 



l<n<Nt 

is always a process with independent increments. We can drop the assumption that 

N 



^ — ^ to provided we can verify that for some A{t), 



lim 11^ E W^^,„-^W||li(p«) =0 



kN + l<n<kN+Nt 



Proof. Since the conditions of Theorem 15.11 are satisfied here, £,N,kN converges in 
distribution as A'^ — > oo to a Gaussian process with independent increments whose 
distribution we denote by 7. Now, ii fiN denotes the joint distribution of and 
^N.kni') the convergence of the marginals imphes the tightness of /ijv- Taking a 
subsequence if necessary, we can assume that /xjv has a hmit /j with marginals A 
and 7. We need to prove that ^ = A x 7. It is enough to prove that ii E C X 
and F C £'[0,T] are continuity sets of A and 7, respectively, then iJ.{E x F) = 
X{E) X j{F). We can assume without loss of generality that X{E) > 0. Set 
Bn = {uj : FNiuj) e E} then PNiBN) Xi^E), and so PAr(Sjv) > lX{E) > for 
N large enough. In view of Remark 15.51 ^N.kni') converges in distribution under 
Pn.Bn as A'^ — )■ 00 to a Gaussian process with independent increments and since, 
clearly, under Pn,Bh we have convergence in B4 to the same A{t) = A{t+tQ) — A{t[)) 
as under P^, it follows that the distribution of ^Ar.fc„(-) under Pn,Bn converges to 
7. In particular, since is a continuity set, 

Pn,bA^ : iN^kA-) e F] = ^l^^^ f ^ 7(^^). 

Since E x F is a continuity set of /i, this proves that ^^^^^ = liF)- D 

5.7. Corollary. Assume that we have a triangular array consisting of Qn.u- 
measurable random vectors U M.n ■ ^ ^ R'^ o,n-d that each linear combination 
(A, C/AT.n) satisfies the assumptions In particular, 

hm V (A,I^A,,„)2]-(A,A(t)A)|U,(p)=0. 



l<n<Nt 



Then 



N ^ 

kK + l<n<kN+Nt 



converges in distribution on the Skorokhod space D[[Q,T]-R'^] to the Gaussian pro- 
cess rj{t) with independent increments taking values in , having mean and 
covariance 

E[{Xiim-vis))f]^{XAAit)-A{s))X). 

Proof. By the results for the scalar case, the distribution of (u,^jv(i)) converges to 
a Gaussian process with independent increments. This implies compactness of the 
distributions of the vector process £,n{-). Let Q be a limit point of distributions 
of ^AT and let rj be the corresponding limiting vector process. By the above for 
each constant vector u the distribution of the increments {u, r]{t) — r]{s)) must be 
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Gaussian and, therefore, by the Cramer- Wold argument, ?7(t) — f?(s) has under Q the 
d-dimensional Gaussian distribution with mean and a covariance matrix {Aij{t) — 
Aij(s)}. Moreover, by Theorem I5.6[ under Q the random variable {u,r]{t) — r]{s)) 
is independent of {??(t) : t < s} for every t > s and u S R'^. This is sufficient 
to determine Q as the distribution of a Gaussian process ri(t) with independent 
increments taking values in having mean and covariance 

and establish that the distribution of 

^ kN + l<n<kN+Nt 

converges to Q on the Skorokhod space D[[0, T]; R"^]. □ 

Next, we break the proof of Theorem l2.2l into several steps and use the following 
representations 

(5-2) Yl,q^in) =^i,q,in),l +J2T=ll^i,qiin),2'- —Y.i^q^(^n),2^-Ai 

Ci.N,o{t) ~ -^J2l<n<Mi{Nt)^i.qiin),lj 
Ci,N,r{t) = ^ Z]l<Ti<A/,(JVt)K,9>(n),2'- " Yi,qi{n),2'-i]: ^ > 1 
and £,i,N{t) = J2T=1 Ci,N,r{t) 

where Mi{u) = uifi>fc + l and Mi{u) = u/i for i = 1, i. First, we establish 
5.8. Proposition. For each fixed u, as N goes to oo, the partial sums 

u 

r=l l<n<Mi{Nt) 

form a tight family of processes on the Skorokhod space D[[0,t];R'']. All the limit 
points are Gaussian processes with independent increments. The second moments 
are uniformly integrable so that the covariance of the limiting Gaussian process 
can be identified as the limit of the covariances of the corresponding approximating 
processes along the subsequence. 

Proof. We note that i^i,gi(n),r is J^_oo,gi(n)+r measurable. In order to apply Theorem 
15.11 with Qn.71 = ^~oo,qi{n)+r wc need to verify the conditions B1-B4. With such 
choice of QN,n, Bl is clearly fulfilled. To verify the uniform square integrability 
of {Yi q.(^n).r\ '^c obscrvc that the uniform square integrability of any family {Za\ 
implies the uniform integrability of as a and Q vary. The distribution 

of {X(n)} is the same for all n and therefore by our moment condition, 
are uniformly integrable. Using the bound |F| < C(l + ^ it is easily seen 
that {Ki q. („) ,,} arc uniformly square integrable. To control ,,|J^_oo,;] II2 

we use (|3.14p of Corollarv l3.6l for (ji-i(n) + r <l which yields the estimate 

\\E\Yi^q,(n)A^-a^M2 < c(d,p, K, L)c{'f^,jg,)wq.p{qi{n) -r-l) 
provided qi{n) >l + r. On the other hand, if qi-i{n) + ?'>/, we can write 

l|-E'K,gi(n),r|-^-oo,z]||2 < 1 1 ^^K.g; (n) ,r |-^-oo,gi_i (ri)+r] II 2 

< c{d,p, K, i)c(7„i,7qjn7q,p(gi(n) - qi-i{n) - 2r) 

< C{d,p, K, L)c{'^rnjlqu)T^q,p{n - 2r) 
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whenever n > 2r and n > n* = n*{i) = niin{TO : qi{l) — qi-i{l) > / V/ > m} 
observing that rt* < oo by (|2.12p . Assuming that q > p, we can always bound 'cup^q 
by 1. Therefore, choosing c(n) = 1 for smaU values of n (there are at most n* + 2r 
of them) and estimating c(n) by either c{d,p, k, i)c(^m, lqL)''^q,p{qi{n) — r — Z) or by 
c(d,p, K, i)c(7m, 7(jt)o7q. p(n — 2r) we arrive at B3 with the estimate 

oo oo 

^c{k) < [??* + 2r + 2^Wp,q{n)]c{d,p, K, L)c{'-f,n,1qi.)- 
n—0 n—1 

If we set 

oo,mJ 

n>m—r 

then it follows from the above estimates that 

(5.3) sup ||i?j,;.,.||2 < 2{n* + r + e{p,q))c[d,p,K,L)c{-frn,lqL) 

i,l 

where 9{p, q) is given by (|2.14p . It is now clear that Wi^n,r = Yi,n-r,r + Ri,n+i,r ~ 
Ri^n,r is a martingale difference and is uniformly square integrable. While B4 may 
not hold, the limit will exist along suitable subsequences. The uniform bound on 
II W'i.„^i.||2 ensures that limits Ait) will be Lipschitz continuous functions of t and 
the convergence is uniform in t. □ 

In order to obtain convergence of processes ^i^n and not only their approxima- 
tions £,i^N,r we will need uniform bounds in the representations (|5.2p . 

5.9. Proposition. The differences {Ci,N,r{t)} satisfy 

(5.4) sup max | sup |Ci,Ar,r(t)|||2 < C* < c». 
■^Ar>ii<«<^ 0<t<T 

Proof. Set Yi^n.r = Y,^n,2'- - >i,„,2'-i, T >1 and 

Ri^n,r — ^ ^ -^(^,m,r l'^— oo,Ti-)-2^ ) • 

Estimating conditional expectations here by Corollary 13. 6f iv) when m ~ n > 2' '''^ 
and by the contraction argument when n + l<m<n + 2''+^, and applying 
Corollary [321 iv) after that again we obtain 

(5.5) ||i?.,„..||2 < 2'-+i sup„ ||K,„,,||2 + CiiPiq, 2-)f + (/3(g, 2-^)Y) 

<C2-{{p{q,2-)Y ^{p{q,T-^)f) 

where (7, (7 > do not depend on i, n, r. Now observe that 

(5.6) Ci^N,r^—j= ^i,gi(T?j.).r -r={Ri.qi([Mi(NT)]),r — Rifi,r) 

l<rn<KU(NT) 

where Zi^n.r = i^i,n,r + Ri,n,r — Ri,n-i,r, 7T. > 1 is a martingale differences sequence 
with respect to the filtration {Gn, n > 1} with Q„ = J^_oo,ri+2'-- By the Doob 
inequality for martingales 

(5.7) -k^^'^P0<t<T\j2l<l<Nt^i,qi{l),r\ ^ 7{Hl<l<NT^^i,q,(l),r 

< 4Tmaxi<i<jvr-BZ2^^(j)_^ < 12r(sup„ ||i;,„,.||2 + 2sup„ ||i?,,„,.||2). 
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We can estimate also 

(5.8) jj E ma.XQ<i<NT \Ri_g.(^i)^r ~ Ri,0,r\'^ 

< JiJ2l<l<NT^^lq,(i),r ^ 4maXo</<ArTi?i?^q^ (,),,. 

Now collecting ()5.5p - ()5.8p and applying Corollary 13. 6( iv) again to ()5.7p and ()5.8p 

we obtain that 

(5.9) supli sup \Q,NAm\2<C2^mqX))' + WiqX-')Y) 

N>1 0<t<T 

where C > does not depend on r. Since X]r>i('^('?' ^))'' converges by our assump- 
tion (|2.15p then X]r>i 2''))'' converges, as well, and so the right hand side 
of (|5.9p is summable implying (j5.4p . □ 

Next, we deal specifically with the terms ^.j-jj), k + 1 < i < £ which satisfy 
(HHni), (PH]) and (pi^ . By Propositions [EH and [El any possible limit 77,; (t) in 
distribution of 

^ n<Nt 

for 1 < i < f will be a Gaussian process with independent increments. The processes 
{77i(-), k + 1 < i < i} will be mutually independent as well as totally independent 
of {rii{-), 1 < i < fc} which is proved by successive application of Theorem l5.6l We 
note that it is enough to show that for any T < 00 we can ignore X]n<fcjv(i) ^i.9i(") 
in the definition of ^i,Ar(t) where k^ii) = max{?T, : qi{n) < qi-i{NT)} so that 
Theorem 15.61 will be applicable then to the approximations 

^i,N,r{t) — —7= ^ ^i,gi(n),r 

^ kN{i) + l<n<Nt 

with ,j.(„) defined at the beginning of Section [4] At the end, relying on Propo- 
sition [5]9] we can let r — 00 and complete the proof. From p.l2p . for any e > 0, 
qi{Ne) > qi^i{NT) for large N which implies that the the initial terms are at most 
Ne in number. Since e is arbitrary we see that N~^kN{i) — >■ as 00. By 

(j4.3|) of Lemma [4.21 we obtain that the contribution of initial fc7v(«) terms in the 
sum for ^i^jv is negligible. Similarly we conclude that it does not matter whether 
we take the sum for £,i^N,r{t) above till Nt or till Nt + kf^{i) as in Theorem l5.6l By 
ProDOsition l4.5l we have also that the limiting variance Ai^i{t) of each £,i.N{t), i > k 
exists and is given by (|4.12p . 

We observe that independency of processes r/i, i > k of each other and of ry^, i < k 
can be proved in an alternative way without using Theorem 15.61 Namely, we can 
rely on Theorem l5.1l showing that linear combinations of processes ^i,7v,r converge to 
Gaussian processes deriving similarly to above via uniform estimates of Proposition 
15.91 that linear combination of processes 77^ are Gaussian and concluding the proof 
via the vanishing covariances assertion (|4.13p of Proposition 14.51 

Now, we are able to complete the proof of Theorem l2.2l First, we conclude from 
Propositions 15 .81 and 15 .91 together with Corollarv l5 . 71 that the fc-dimensional process 
{^i,N{t) : 1 < i < k} converges in distribution as A^ — > 00 to a Gaussian process 
{r]i{t) : 1 < 7 < fc} with stationary independent increments whose covariances are 
given by Proposition 14. II As explained above, when z > fc -I- 1, the process £,i,N{t) 
converges in distribution to a Gaussian process rii{t) with stationary independent 
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increments and rjk+i (t), r]i{t) are both mutually independent and independent of 
processes rii{t), r]k{t). It follows that the ^-dimensional process {^i,7v(i) : 1 < * < 
f\ converges in distribution as — !• od to the Gaussian process {rji{t) : 1 <i < f\ 
with stationary independent increments whose covarianccs arc given by Proposition 
14.11 and Proposition 14.51 taking into account independency of processes rji{t) with 
i > /e + 1 of other processes rij{t) with j 7^ i. 

It remains to show that the process {t) given by (|2.20|) converges in distribution 
as — > 00 to a Gaussian process ^(i) given by (|2.23p . The convergence itself is 
clear since each ^i^^r converges to the corresponding 77^. In order to show that ^ 
is a Gaussian process it suffices to prove the same for = since 
C,{t) ~ Si=fc+i'?«(^) ^ Gaussian process (as a sum of independent Gaussian 
processes) independent of C, and so C(0 + C(0 is a Gaussian process if C,{£) is. Since 
{r]i{t), ...,rjk(t)) is a fc-dimensional Gaussian process with independent increments 
then the vector increments [rjjiit) — rij{{i — l)i), i = 1, 2, fc) for j = 1, 2, k are 
mutually independent fc-dimensional Gaussian processes, and so 

i=l j=l j = l 1=1 

is a Gaussian process for any choice of constants and we recall that ?7j(0) — 
€j,Jv(0) = 0. Now observe that choosing Ay = 1 ii i < j and Ay = 0, otherwise, we 
obtain that Cx{t) = ({t) completing the proof. 

As to our claim that increments of ^{t) may not be independent if fc > 2 consider, 
for instance, the case fc = £ = 2 and 

at) - at/2) = m{t) + 772 (2t) - 771 (V2) - m{t) and ^(^2) = ^i(i/2) + V2{t). 

Then by Proposition 231 

E{at/2)m-atm) =D2,it/2 

where 

^ 00 

-^2,1 = 2 E «2,l(w) 

and 

a2,i(u) = / F2{x,y)Fi{z)dfi{x)dfiu{y, z). 



Assume, for instance, that A(0), A"(l), A(2), ... is a sequence of independent iden- 
tically distributed random variables then /i„ = /i x /i if u 0, and so 02.1 (w) = if 
u while 

a2,i(0) = J F2ix,y)F,iy)dti{x)dti{y). 

Now suppose that EX{0) = 0, EX'^{0) = 1 and choose F{x,y) = x^y'^ - 1. Then 
/ F{x,y)d^j,{x)d^i{y) = 0, F2{x,y) = x^{y'^ - 1), Fi{x) = x^ - 1, and so 

^2,1 = ^02,1 (0) = J (z/ - l)2d/i(y) 
unless X^{0) = 1 with probability one. □ 
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6. Continuous time case 

First, we represent again the function F in the form p.l7|) and ^Ar(t) given by 
(P3T|) in the form (P^^ where now 

1 rS,{Nt) 

(6.1) / F,{X{q,{s)),...,X{q,{s)))ds 

vW Jo 



with Si{u) = u/i if i < fc and Si{u) — u ii i > k + 1. Set 

Fi.r.t Fi^r,t{xi, ...,X.i_i,Uj) = E{F{xi,...,Xi^i,X(t)\J't^r,t+,-), 

Xrit) = E{X{t)\Tt-r,t+r), Y,{t) = (X (gi (s) ) , . . . , X {q, (s))) if t = 
and = if f 7^ gi(s) for any s, = ^i,r,t(^r(9i(s)), -'^r(gi(s))) 

if f = (7i(s) and Yi j.{t) = if i 7^ qi{s) for any s. 

In order to use fuUy our discrete time technique it wih be convenient to pass 
from S,,,N to S.i.,N given by 

-, IS.iNt)] 
^ n— 

where Ii{n) = /""''"'^ yi((7i(s))(is. The error of such transition is estimated by 
(6.2) sup \Ci,N{t) - 6,w(OI < -y= , ™ax Q,(n) 

0<t<T V-'V 0<n<NT 



where Qi{n) = \Yi{qi{n + s))|rfs. Now for any S > 0, 

P{inaxQ<n<NT Qt{n) > eVn} < NTinaxa<n<NT P{Qt{n) > e/ZV} 

< ^maxo<„<wT/{Q^(„)>,y]v} QUn)dP 

< (£^/]V)-* / Ql+\n)dP < (eVN)-^ EY^+\q,{n + s))ds < C{eVN)-^. 

Thus, the left hand side of (|6.2p tends to in probabihty as — > 00, and so it 
suffices to prove our functional central limit theorem for f^^jv in place of ^i^N- 
Introduce the approximations (,i.N.r of ^i^N by 

^ IS.(Nt)] 

(6.3) ^»,JV,r(t) ^'''■(") 



n=0 

where Ii r{n.) = J^^^ Yi r{qi{s))ds. Now set 

00 

Rt,r{m) = ^ -B(/j,r(OI-^-oo,m+r) 

and Zi rim) = Ii,r{ni) + Ri ,.{m) — Ri r{m — 1). Then E(Zi,.{m)\T_ao.m-i+r) = 0, 
and so {Z^, Gm}m>o with = Zi j.{m) and C/^ = J^_oo, m+r turns out to be a 
martingale differences sequence. We saw already above that {Q^ (n)} is uniformly 
integrable. Then both {Ii{n)} and ^'^s uniformly integrable and like in 

the proof of Proposition 15.81 we conclude that both {i??^(n)} and {Zf^{n)} are 
uniformly integrable, as well. Set 

^ IS.iNt)] 
Ci,N,r{t) = -r= ^ Z^^r{n). 
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Then similarly to Section [5] we obtain that 

(6.4) sup l^i^jv.r(i) — Cj,Ar,r(i)| in probability as iV —>• oo, 

0<t<T 

and so in order to obtain a central limit theorem for S,i_r,N{t) it sufSccs to prove it 
for the normalized martingal Ci,r,Nit)- 

In order to invoke martingale limit theorems we have to study next the asymp- 
totical behavior as iV — > oo of normalized variances i?(Ci,r,Ar(5'i(-/Vi))) . As in the 
discrete time case considered in Section |4l in view of (|2.17|) and (|6.ip it sufhces to 
study the asymptotical behavior of 

(6.5) Aj(A^, s,t) = E[^,,Nis)ij^Nit)] 

W l!'^'''^ lo '^"'^ E[UqAu))Y,(q,{v))]dudv. 

We treat first the case when I < i, j < k similarly to Proposition 14. II Let v be the 
greatest common divisor of i and j then similarly to the argument in Lemma 14.41 
we obtain that for any integer 

(6.6) lim E[Yi{iu)Yj{jv)] = ai,j{'w,2w, ...jVw) 

u,v—^OD.iu—jv—wv 

with ai j defined in Proposition 14. II Now, changing variables we have 

(6.7) ^ /J^*/^' /J^^/^ Emu)Y,ijv)]dudv 

= m Gif'^^ E[Y,{^)Y,ijv)]dwdv. 

When V is large then the expectation under the integral equals approximately 
aij{w,2w, ...,vw) and taking into account that the latter is absolutely integrable 
in w from — oo to cio we can approximate the interior integral in w by the in- 
tegral J_^- Next we integrate in v within constraints < < Nt/j and 



N 
j 

It follows that the expression in (|6.7p is approximately equal as iV — >■ oo to 



u = {jv + wv)/i < Ns/i, i.e. asymptotically for N large < v < y min(s,t). 



— min(s,t) / ai jiw,2w, ...,vw)dw 

V J~oo ' 



and we obtain the same covariances as in the discrete time case. 
Next, we claim that for each i = k + !,...,£ and t > 0, 

(6.9) lim D^,{N,t,t) = 0. 

Indeed, set again bij{u,v) = E(Yi{qi{u))Yj{qj{v)) . Then 

(6-10) ^/o^*/o^* \bi^;{u,v)\dudv < du \h^i{u,v)\dudv 

+ ^ /«+*7 v)\dudv + ^ J^^ du /j^*^ \bi4u, v)\dudv 

<C{tj + j + tl3['\Nj)) 

for some C > independent of t, N and 7 where we obtain by (|2.30p and estimates 
similar to Lemma l42l and Proposition 14.51 that for any i > k and 7 > 0, 

POO 

(6.11) (3^'\M)^snp \b,,{u,v)\dv < 00 'And lim (A/) = 0. 

So, letting first — > 00 and then 7 — > we obtain (|6.9p . 
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6.1. Remark. In fact, in the continuous time case we can take qi{t) ~ ait for 
arbitrary < ai < a2 < • • • < afc in place of 1 < 2 < • • • < fc while leaving 
qi{t), i = k + 1, ...,£ as before. In this situation (|6.6p becomes 

lim E[Y^{aiu)Yj{ajv)] = aij{piz, p2Z, z, z) 

where pi < p2 < ■ ■ ■ < Pmj < 1 and aipi,ajpi G {ai, ...,ak} for I ~ l,...,nij. Then 
the covariances (|6.8p will have the form 

1 f°° 
min(s,t) / ai,j{piw,p2W, pnijW,w)dw. 
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